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ABSTRACT 

Self-instructional booklets simulating 
computer-assisted instruction (CAI) were used to teach four basic 
concepts in science to first graders in three treatment groups which 
received different types of feedback — hints, correct answers, and 
right or wrong. A control group received neither instruction nor 
feedback. A multiple-choice test was administered to the 47 students 
in the 4 groups following completion of the instruction. It was found 
that the group provided with hints had the highest mean; the group 
provided with the correct answer had the second highest mean; the 
group provided with right/wrong feedback had the second lowest mean; 
and the control group had the lowest mean. The results were 
inconclusive with respect to the hypotheses as there were no 
significant differences among the group means. Possible causes are 
suggested in the discussion that concludes the report. A table 
summarizing the means and standard deviations, a flowchart showing 
the hypothesized model of relationships between different forms of 
feedback, and samples of generalities, practice items, and test items 
are provided. Lists of 12 references and 10 prior IDD&E working 
papers are also included. (Author/RP) 
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Self instructional booklets *ere used to teach four 
basic concepts Id Seleses to 47 first graders. Different 
kinds of feedback were applied to different trestsent 
qroups. A nnltlple-choice test was adsinistered to stodents 
following their cospletion of the instroction. The group 
provided with hints had the highest sean. The group pro- 
vided vith the correct answer bad the second highest seen. 
The group provided sith right /wrong feedbeck bad the second 
lowest seen. and the control grocp had the lowest wean. 
The results were inconclusive with respect to the 
hypotheses. There was no significant difference anong the 
group Beans. Possible causes are suggested in the dis- 
cussion section. 



IlTBOPJCTIO l 



when students are »ade aware of the correctness or 
incorrectness of their response, they re tenter sore on a 
later test (Anderson, Rulaavy 6 kndre, 19"M; Giltan, 1969: 
Heyer, 1960). Kelhaty (1977) identified four concerns 
related to feedback. They are feedback-as-reinforceaent, 
availability of feedback, feedback and learning, feedback 
and learner expectations. 

first, when feedback is used as a reinforcer to shape a 
student's behavior, there is little evidence to support the 
behavior ists* assnsption that desired stents till ocenr. 
Feedback does not have its greatest effect on correct 
responses (Anderson st al; 1971) . There is no good reason 
to believe that the say a reinforcer is used to shape behav- 
ior in a laboratory vill cccor in learning. In a 
laboratory, pigeons look for food because of hunger. In a 
classrooc situation, it isn't necessarily true that students 
hunger for knowledge. Ibere is evidence froa previous 
research that feedback does not act as a functional reinfor- 
cer. in fact, the Delay-Hetention Effect (EBI) strongly 
opposes the reinf or ce tent interpretation of feedback: lear- 
ners *ho receive issediate knowledge of the correct 
responses, or feedback, retain less than learners for vhon 
feedback is presented af*er a period of delay (tfilhavy t 
Anderson, 1971). 

secondly, studies shov that students learn little if 
they can copy answers fros cues available instead of reading 
test (Knderscn, 1970; Kulhavy C Tekovicb, 197ej . The tern 
•presearch availability* refers to situations when students 
can locate the correct answer very easily without first 
searching through the text. Shen presearch availability is 
high, students sicply copy the right answer, when presearch 
availability is low, students have to study hard to produce 
a correct answer, and students learn eorc thrcugh the labo- 
rious search (knderscn, Kulhavy 6 Indre, 19*»1, 1972). 

Thirdly, feedback has two effects cr each response that 
a student takes. One is sorely to let bis know when be is 
wrong. The second is to correct hit cr lot fait correct his- 
self when he is wrong. Ihe theoretical perspective for this 
aspect of feedback is inforsation processing theory. This 
theory assunes that students possess at. least soae prior 
knowledge which can be related to the saterial being 
studied. Feedback to a correct response confirts the action 
and inforss the student of his overall coeprehetsion. Feed- 
back on incorrect answers acts as a correcting agent to 
correct wrcng responses. 

T*e DPE study (Kulhavy C Anderson, 1S*»1) further sup- 
ports this notion. It found that if delay occurs between 
the ertcr and the feedback, incorrect responses tend to be 



forgotten, and there is a greater likelihood that the cor' 
rect answer will be learned fron the feedback. The DFE 
research clearly shows that feedback not only works to iden- 
tify errors, hot also helps the stodents to correct then, 
again, such conclusion is based on the assuartion that the 
stodents coeprehend the instruction in the first place. 
Feedback has littl« effect if the students are unable to 
co a pr eh end the instruction or to fit it into their esisting 
inforaaticn fraiework (Kulhavy 6 Careen, 1972). 

# 

Fourthly, Kulhavy speaks of the concern of relating 
feedback effects to student perceptions* The interaction 
between student expectation and feedback tas a powerful 
effect on what the student resesbers fron the instruction 
fKulhavy, lekovich, S Dyer, 1*76)* If a student has high 
confidence but the response chosen is a wrong one, the stu- 
dent vill spend a substantial asount cf tine figuring out 
vhere the problen is* Consequently, the student is sore 
likely to replace the error vitb the correct answer on a 
later test (Kulhavy, lekovich, S Dyer, 1976) • It vas found 
that high-confidence correct responses yield the shortest 
feedback study tines, high-confidence errors yield the long- 
est tine, and low confidence answers fall sonewhere in 
between* 

There are studies shoving that feedback does not facil- 
itate learniuq (RcDcnald S Allen, 1362; Sullivan, Eaker 6 
Schutz, 1967; Sullivan Scfcutz t Baker, 1971)* Host of the 
research showing no feedback effect are usually so heavily 
cned that students need not study th« content of the 
instruction at alls Pasically, these studies have a differ- 
ent kind of definition cf feedback fron the kind that we 
have discussed. In general, there is little dcuht that 
feedback is cne of the aost powerful tools in instruction* 

We postulate that the aost powerful aspect cf feedback 
lies in its corrective function. It is surprising that lit- 
tle work has been done to determine what kind cf feedback 
results in the best learnings lie are interested in examin- 
ing what specific kind of feedback tessage is tost effective 
for the correction of errors. f>e postulate that providing 
hints rather than serely the correct response after an error 
should inprove learning because it rcguires learners to 
etert aore effort to search for the correct anrwer» Thus, 
it generates greater depth of inforsation processing. The 
purpose of this study is to test this proposition. 



Def inition s 



The word 'feedback 9 is used in this study to represent 
any kind of nessage that (1) is related to a response and 
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|2) is provided to students after the response. It can re 
presented in the fori of a hint, the conect answer, or 
right/wrong knowledge of results, ft hint is defined as 
isforaation providing elves for the discovery of the error 
when an incorrect response is aade and identified, ft cor- 
rect answer is the response that shonld have been given in 
place of an incorrect answer. It does not inclnde inforsa- 
tion about the correct process to ose. Flght/fTflBfl, 
knowledge of resolts is telling students if their responses 
are right or wrong, and nothing sore. 

The hypothesized nodel in Pignre 1 illustrates differ- 
ent stages of bow different forss of feedback function dur- 
ing the learning process. The rightnost branch indicates a 
process when no correct answer is provided. In this case, 
the learner has no other choice but to go cn to the next 
practice itee. In ether words, as infornation processing 
theory puts it, no action of encoding or decoding is happen- 
ing. It is predicted that the anount of learning, in this 
case, is sinisal. Ihe nest branch to the left indicates 
what happens when a learner is provided with the correct 
answer. sose kind of process is taking place in the 
learner »s brain, for he has to replace the error with the 
correct answer. Ihe second next branch to the left indi- 
cates what happens when a learner is provided with a h int . 
Given a hint to work as a corrective agent which provides 
clues leading to discovery, the student is likely to spend 
wore tire on the p rob let. ftt the sane tine, he has to go 
through rore coaplicatcd infer nation processing. First, he 
has to locate the source of the nlstakc. Then, he has to 
find out the correct answer. Ibis involves several runs 
through of encoding and decoding which should autotatically 
increase the level of conprehensicn. 



Insert Figure 1 atcut here 



There is evidence that the presence of feedback in any 
forn can facilitate learning (ftnderson, Kulhavy S Andre 
ig71; Gilnan, 1969; Beyer, 1960). le hypothesise the sane 
thing : that feedback in any fort will result in better 
learning than no feedback, He also hypothesise that supply* 
ing a *hint* after an errcr is note effective than providing 
other forns of feedback. This hypothesis is sade based cn 
the fact that whenever learners are wade aware ot their 
wrong perforsance, they inst not only elivinate the wrong 
response, but tust also look for the correct response to 
replace it. ft hint, in this case, works as the corrective 
agent. It functions in two ways. First, it helps the stu- 
dents to identify the inaccuracy of the instructional 
response. Second, it acts as a corrective agent leading the 
students to the discovery of, and deep encoding of, the cor- 
rect answer, not just a superficial, rote processing of the 



cornet answer. Hence, bints requite a great deal of active 
intonation processing throughout the correct iff process. 



■BtlOPS 



The students sere three classes of first graders in a 
private eleaentary school. In this private school, acadesic 
achitveaent , discipline and conservative biblical belief arc 
squall i eapbasired on a daily basis. The acadesic standing 
of the first graders in this school is higher than that of 
the first graders in public schools at Syracuse, neverthe- 
less, tbej are just norsal kids fros the general population, 
a total of «H first graders took part in this esperisent. 
Students in classes I and II sere assigned randosly tc three 
different treatsent groups. Students in class III were all 
assigned to the control groups 
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The experimental design was a posttest-only control 
group design (Caapbell 6 Stanley, 1<€2) . I cne-vay analysis 
of variance vas chosen as the statistical procedure, also, 
results sere covaried with Stanford standardised letter and 
Sound lest scores. 



Task aad Materials 



For this study, a self instructional booklet was used 
to teach four basic concepts in Science z solid Batter, liq- 
uid satter, gas, and energy. In this self-study 
instruction, the definition of esch concept vas presented 
and followed cj exaaples. Then, practice followed. Since 
this study investigated the effectiveness of feedback of 
different forss, cather lean instruction was used. Only one 
exasple was provided for each of the four concepts. The 
eaphasia was on the last phase of the instruction - 'prac- 
tice*. It was during practice that different kinds of 
feedback were planned for different treattent groups. Sas- 
ples of the definition and examples are provided in Figure 
2. Saaples of practice for each treatsent group are pro- 
vided in figure 3. 
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insort Figures 2 8 3 about here 



Only one practice itee appeared per page. The Ijestion 
and the nultiple choices eere printed on the left "J 
each page. feedback was printed on the right half of the 
page oppoaite each of the aoltiple choices (eee Figure 3). 
ill the feedbacks on the right side were covered up with 
colored strips of paper that sere taped on both «™* ™ 
dents eere instructed to peel only the strip corres £ 0 ™ iB * 
to the choice they eade daring practice. »n *ysj ec ti<>« « 
the booklets after the study eas ran revealed that the sta 
dents did in fact follow this procedure correctly. 



there aere three treateent groups and one control 
groap. The Ci group eas provided with the correct answer 
•hen an error eas identified during practice, the Bint 
group aas provided eith hints ahen an error 
during practice. The B/i grows aas F*ovided iafotM- 
tion as to abether their responses aere right or wrong dur- 
leg practice. When stadents in the Hint and "groups did 
give the correct answer, the* aere given the 
cellent*. The control group aas given no instruction nor 
feedback of any kind. See Fignre 3 for an eiaaple of each 
kind of feedback. 



JtSlilSSI 

The instruction was intended for conpoter Assisted 
instruction <Cll) . since nicro-cenputers aere •li- 
able at the school, a clcse siaulation of tlie aatenals in 
the forn of tcoklets aas used. 



Te«f and Measures 

* test ct 20 aultiple-choice goestions aas a** 1 *****"' 
to all students insediately following the treateent. The 
test aas at the application level, which reguired the stu- 
dents to apply abat they had learned to new instances. Jonc 
of the esanplis nor the practice iteas troa the "l*-study 
instruction appeared in the test, tut all itets (F,, f, and 
T) aere drawn free the sai* pool. Ihe test was reviewed by 
one of the teachers beforehand, and was revised according to 



the teacher's reconoendation. A staple of the tost iteas is 
provided in Figure 4. 



Insert Figure 0 atoot bare 



Prior to the data collection, three conferences vere 
scheduled vith one of the teachers to verify the content of 
tte aaterials and the level of the instruction. Materials 
were reviewed by the teacher. sose ninor details were 
revised following the teacher* s reconaendations. One first 
grader iron a public school pilot-tested the aaterials and 
failed to cotplete the task, therefore ve decided to change 
our strategy by sacrificing one student fros the sasple pop- 
ulation for an additional pilot test. This student proaised 
to keep this a secret cetveen us. Be told sc that he did 
not talk abont any of this to ant of his classaates. Re 
vent through the self-study instruction and the test in less 
than half an hour. Soae ainor revisions were nade accord- 
ingly. 



procedures 



The study was carried out class by class, upon enter- 
ing the classroos, the students were told that this vas a 
new project they were going to be working cn. Directions 
were given orally. And they were told to work at their ovn 
pace. Following tbn directions, a list of nev vords vas 
written on the blackboard and was taught by the teacher to 
the whole class very discretely. • Discretely' aeans that 
the teacher tade an effect to separete the acaning of the 
word froa the concepts taught ty the stufly. Per exaaple, 
when teaching the word *helius*, it was presented as sore- 
thing put inside the taloon vhich would aake the ballon go 
op. Actually, sost of the new vords were recognized iaae- 
diately after they vere pronounced. Then, the self-study 
instruction booklets vere handed cut randcvly. The students 
vorked on their own booklets individually, and raised their 
hands when they were done with then. Students then returned 
the instruction booklets to the teacher and received the 
test. Those who finished early aire directed to an open 
area at the back of the classroos to vork cn previously 
assigned hoaevurk. 

Class II went through the save procedures iasediately 
after Class I bad finished their esperiaent. The control 
qroup (Class III) was given the test only after class II had 
finished their exFeriecnt. 
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The analysis of covariance was act I* 1 * 0 " 80 **** 0 ?*, 
tba covariate vaa not significantly correlated vita the 
da pandect variable. In analyaie of variance xcr *■« 
poateet fielded an r-ratic significant at tie 0.007 level of 
probability. 1 euaaarv of aeaaa and standard deviations is 
sboen ia Table I. 



Insert labia I about bare 



Hypothesis 1 stated that feedback in aav forn will ke 
better than no feedback. I tost boc pair vise ecu perinea 
(Dencaa) was perforaed to test tbis hjpothesis <aee Table 
1). it revealed that the Hint group and tbe CI group f«- 
foraed better than the ccntrcl grcup, bet tbe differences 
anong the Bint group, tbe CI grc«p, and tbe B/i groop were 
not significant. The difference between tbe i/i grcup aad 
the Control group was not significant. Hypothesis 2 stated 
that supplying a 'hint* after an error ia aore effective 
than providing other ferns of feedback. Icccrding tc the 
results of tbe post bec pairvise ccupariscn, there 
isn't any significant difference aecng the Hint group, the 
Ci group, and the B/l grcup. The aeans eere all in the 
hvpotaeslsed order, but none of these differences eere sig- 
nificant. 



Hypothesis 1, that feedback in any fore vill do better 
than no feedback, is partially supported. Sesults froa this 
study shoa that there are significant differences between 
the Hint grcup and the Ccntrcl group, and between the ca 
qcoup and the Control group. But the paver ie not great 
enough to detect significance fcr tbe difference between B/i 
feedback and the Ccntrcl. Inderscs et al <1971) concluded 
froc their study that telling students vhether or not their 
answer is correct increases the ascent of aaterial "■«■" 
bared on a later test. Ihe lack cf significance between the 
B/H feedback and the control could possitly ke due to the 
fact that different task levels are involved in the differ- 
ent studies. inderson et al <1971) studied the reaenber 
level, while we investigated the application level. 1 wore 
likely eiplanation, given tbe strong espiricel sup pert for 
tbis hypothesis <lnderscn, kulbevy. * Indie, 1971; Gilaai, 
1969; Hcyer, 1960), is that our power was not sufficient to 
detect a real difference. 
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Uypotheala 2* that prcvidiag * 'hint* after an error is 
•oca effective than providiog ether fcras of feedback, la 
only farU.il It supported. Ikcre aaa do sigoificaace aeoog 
any of the faadback groups, noeewcx, tee aaaaa aaca in the 
hypotkeaised direction, and again tka power aaa lea ie tkia 
study* 

Tka lack of •igaificaace coold ilao be the reaalt of 
inefficient practice itaaa. Inanfficient practice in a 
•tod j iavestigating the effects of feedback eight be detri- 
mental, becaeae tka affecta of feedback aill be larger vhea 
practice aad feedback carry tka aajcx kardco of the iaatrec- 
tioa. Ibea tka generality and exaaplea are rich aad 
plentiful, feedback aill pronebly lake each lcaa of a dif- 
ference, fleece, dlffereat types of feedback ecold eake less 
of a difference* Therefore, «e feel tket the bypotkeaized 
aodal need a a the tbecreticel perspective for thla atody ie 
•till logical aad valid baaed oo theoretical aapport frca 
iafcraatlon proceasiag theory* partial aapport iron thia 
stady, and aapport frca previous reaearch (laderaoa, 1967, 
1970s innet, 196k). In light of all theae, the eejor 
implication for practice ia that any kind of feedback is 
better than no feedback ca atodeat errora. lith respect to 
type of feedback, providing bint feedback la, if act beat, 
juat aa good aa providing ctket kinda of feedback. 

Further reaearch ia aeeded to iaveatigate the results 
found in this study. Using a larger saaple size aould 
ieprote the poeer of the study. Using cosfotera aa the 
aeane of delivery aould be aore appropriate and nore con- 
trollable aa far aa the nuaber of freac8 aad lcagth cf tiae 
are concerned. Bore practice iteaa cugbt to be provided ia 
the lessen, aince ue went to investigate the power of feed- 
back, lnother very inportant aspect for future reaearch is 
to investigate if different ncdels ere needed fcr different 
task levels, i.e. reaeaber-a-generalit j, reiseafcer-an- 
inatance, and use-a-geterality. 
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1. This was an error on the researcher's part that 
randon assignment was not used in Class III* In order 
to filter ont differences fcttseen classes , scores 
fros a standardised test on letter and soand mas used 
as a covariate when analyzing data. 



2. The Stanford Standardized letter and Soncd lest 
is a standardized test to measure early school achieve- 
ment. 
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fblm 1 Sttwan of t Standard Deviations 
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» shows the results of post hoc Duncan paitsise co.parison. 
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^|«ur* 1 s Hypothesized model of relatlonsnip between different forms of feedback. 
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ft solid has a definite size and shape. 
For eiasple : 

Rood has a definite size and shape . 
So* 

Hood is a solid latter. 

Solid can be hard or soft . 
For exavple: 

wool is soft , but has a definite si re and shape. 
So, 

Bool is also a solid natter. 
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Et gpjgg of »r*ctice It— S for «nch Treafent 



1 eat is 

1) « solid aattsr 

2) ft liquid Batter 

3) a gas 

a) a kind of eoergy 



•Excellent* . , 

loo are wrong. The correct answer is i. 

Too are wrong. The correct answer is l. 

Ton are wrong. The correct answer is 1. 



« cat is 

1) a solid natter 

2) a liquid Batter 

3) a gas 

4) a kind of energy 



•Excellent* 

h cat has a definite size and shape. 
k cat has a definite size and shape. 
* cat has a definite size and shape. 
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i cat is 

1) a solid natter 

2) a liguid natter 

3) a gas 

*) a kind of energy 



Ton are right. 
Ton are wrong. 
Ton are wrong. 
Ton are wrong. 



Con£rol_groap 



* cat is 

1) a solid aatter 

2) a liguid natter 

3) a gas 

4) a kind of energy 
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1* Bicycling is an example of 

a) a solid aatter 

b) a liquid aatter 

c) a gas 

d) a kind of energy 

2. Sugar is an ezaaple of 

a| a solid aatter 

bj a ligaid aatter 

c) a gas 

d) a kind of energy 

3. Glue is an ezaaple of 

a) a solid natter 

b) a ligaid aatter 

c) a gas 

d) a kind of energy 
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